Gas detection device that visualizes gas

ABSTRACT

A gas detection device includes: a processor that visualizes a gas by performing image processing on infrared image data in an inspection region imaged by an imaging device; a display that displays an inspection image that reflects a result of the image processing; and an input interface that receives an input of supplementary information on the inspection image displayed on the display.

CROSS-REFERENCE TO RELATED APPLICATIONS

The disclosures of Japanese Patent Applications No. 2018-139158, filedon Jul. 25, 2018 and No. 2018-153951, filed on Aug. 20, 2018, includingthe specifications, drawings and abstracts are incorporated herein byreference in their entirety.

TECHNICAL FIELD

The present invention relates to a gas detection device, a gas detectionmethod, a display control method, and a non-transitory computer-readablerecording medium storing a program.

BACKGROUND ART

A gas leakage detector that detects a gas leak in an inspection regionby using characteristics of gas for absorbing infrared is conventionallyknown (see Patent Literature, (hereinafter, referred as “PTL”) 1).

PTL 1 discloses the gas leakage detector including an infrared cameraand a visible light camera imaging an image (a moving image) of aninspection region including an inspection target, an image processingsection processing the infrared image data imaged by the infraredcamera, and a display section. The image processing section extracts animage of fluctuation caused by a gas leak from the image data of theinspection region. The display section displays an inspection image inwhich the image data of fluctuation is superimposed on the image data ofthe inspection region imaged by the visible light camera.

PATENT LITERATURE

-   PTL 1: Japanese Patent Application Laid-Open No. 2012-58093

The gas detection device disclosed in PTL 1 allows an inspector tovisually identify with ease a gas leak spot in an inspection region byvisually recognizing the inspection image displayed on the displaysection.

Incidentally, in the inspection image, for example, importance of aninspection image in a normal time is different from that of aninspection image in an emergency time when an inspection target has agas leak.

With respect to such inspection images, for example, only a specificinspection image may be needed (e.g., only the inspection image in theemergency time) while the inspection image in a predetermined timeincluding the inspection image in the normal time and the inspectionimage in the emergency time may be needed. When a user can addsupplementary information to the specific inspection image in theinspection image, then, the user can efficiently extract the specificinspection image from the inspection image. However, the gas detectiondevice disclosed in NPL 1 does not have such a configuration.

SUMMARY

One or more embodiments of the present invention provide a gas detectiondevice, a gas detection method, a display control method, and anon-transitory computer-readable recording medium storing a programcapable of adding supplementary information to a specific image ofinspection images.

A gas detection device according to one or more embodiments of thepresent invention includes: an image processing section (i.e.,processor) that visualizes a gas by performing image processing oninfrared image data in an inspection region imaged by an imaging section(i.e., imaging device); a display section (i.e., display) that displaysan inspection image that reflects a result of the image processing; andan input section (i.e., input interface) that receives input ofsupplementary information related to the inspection image displayed onthe display section.

A gas detection device according to one or more embodiments of thepresent invention includes: an image processing section that visualizesa gas by performing image processing on infrared image data in aninspection region imaged by an imaging section; a gas detection sectionthat detects the gas based on a result of the image processing; and adisplay control section (i.e., controller) that performs display controlto display an inspection image reflecting the result of the imageprocessing and to display detection time information indicating a timewhen the gas is detected by the gas detection section.

A gas detection method according to one or more embodiments of thepresent invention, that is a gas detection method to be executed in agas detection device, includes: visualizing a gas by performing imageprocessing on infrared image data in an inspection region imaged by animaging section; displaying an inspection image reflecting a result ofthe image processing on a display section; and receiving input ofsupplementary information related to the inspection image displayed onthe display section.

A non-transitory computer-readable recording medium storing a programaccording to one or more embodiments of the present invention causes acomputer to perform: gas visualization processing by performing imageprocessing on infrared image data in an inspection region imaged by animaging section; display processing of an inspection image reflecting aresult of the image processing on the display section; and receivingprocessing of input of supplementary information related to theinspection image displayed on the display section.

According to one or more embodiments of the present invention, a gasdetection device, a gas detection method, a display control method, anda non-transitory computer-readable recording medium storing a programcapable of adding supplementary information to a specific image ofinspection images can be provided.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating an exemplary configuration of agas detection device according to one or more embodiments of the presentinvention;

FIG. 2 is a flowchart of flow for inputting supplementary informationduring imaging;

FIG. 3 is a flowchart of flow for inputting supplementary informationduring reproduction;

FIG. 4 is a flowchart of flow for generating and outputting outputinformation;

FIG. 5A illustrates an exemplary inspection image displayed on a displaysection during imaging;

FIG. 5B illustrates an exemplary inspection image on the display sectionbeing changed from the state illustrated in FIG. 5A;

FIG. 6A illustrates a modified example 1 of a second input screen;

FIG. 6B illustrates a modified example 1 of the second input screen indifferent states from FIG. 6A;

FIG. 7A illustrates an exemplary inspection image displayed on a displaysection during reproduction;

FIG. 7B illustrates an exemplary inspection image on the display sectionbeing changed from the state illustrated in FIG. 7A;

FIG. 8 is a block diagram illustrating an exemplary configuration of agas detection device according to one or more embodiments;

FIG. 9A illustrates an exemplary inspection image displayed on a displaysection during imaging;

FIG. 9B illustrates an exemplary inspection image on the display sectionbeing changed from the state illustrated in FIG. 9A;

FIG. 10A illustrates the modified example of the second input screen;

FIG. 10B illustrates the modified example of the second input screen indifferent states from FIG. 10A;

FIG. 11A illustrates an exemplary inspection image displayed on adisplay section during reproduction;

FIG. 11B illustrates an exemplary inspection image on the displaysection being changed from the state illustrated in FIG. 11A; and

FIG. 12 is a flowchart illustrating an exemplary operation of the gasdetection device.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of the present invention will be described indetail with reference to the accompanying drawings. However, the presentinvention is not limited to the configuration of the below embodiments.

Gas detection device 1 according to one or more embodiments will bedescribed with reference to FIGS. 1 to 7B. FIG. 1 is a block diagram ofgas detection device 1. Gas detection device 1, for example, images aninspection region including an inspection target (e.g., a plant) in gasfields, and generates infrared image data of the inspection region.Then, detection device 1 generates an inspection image, in which the gasis visualized by performing image processing on the infrared image data.In addition, when using gas detection device 1 of one or moreembodiments, a user can add supplementary information to the inspectionimage at any timing, while visually recognizing the inspection imagedisplayed on the display section. In the following description, imagesinclude moving images as well as still images.

<Gas Detection Device>

As illustrated in FIG. 1 , gas detection device 1 includes imagingdevice 2 and gas detection device body 3. Imaging device 2 and gasdetection device body 3 are connected with each other via cable 4.Imaging device 2 may be connected to gas detection device body 3 viawireless communication. Imaging device 2 may also be connected to gasdetection device body 3 via a network such as the Internet.

<Imaging Device>

Imaging device 2 is, for example, a portable camera device. Imagingdevice 2 may be a camera device that is fixed to a predeterminedposition. Imaging device 2 may be controlled by, for example, controlsection 35 of gas detection device body 3 to be described below, and acontrol section (not illustrated) or the like included in imaging device2.

Imaging device 2 starts imaging, for example, when an instruction tostart imaging (hereinafter referred to as “imaging start instruction”)is input from a user through operation input section 33 of gas detectiondevice body 3. However, even when the imaging start instruction isinput, imaging device 2 does not need to start imaging in a case whereno imaging information is input from a user.

In particular, imaging device 2 includes visible light imaging section21 and infrared imaging section 22.

<Visible Light Imaging Section>

Visible light imaging section 21 includes, by way of example, a firstoptical system (not illustrated), a first optical filter (notillustrated), and a visible light sensor (not illustrated).

The first optical system forms an image of the visible light incidentfrom the inspection region to be an object on the visible light sensor.

The first optical filter is, in one example, an infrared cut filterdisposed on an optical path connecting between the optical system andthe visible light sensor. The infrared cut filter cuts infrared lightfrom the light which has passed through the optical system.

The visible light sensor is, for example, a CMOS image sensor, andreceives black-and-white BW visible light, or color RGB visible light togenerate visible image data.

Visible light imaging section 21 having this configuration images, forexample, an image of the inspection region including the inspectiontarget (e.g., plant 6 a illustrated in FIG. 5A) in gas fields, andsequentially outputs visible image data to processing section 31(specifically, image processing section 31 a).

The visible image data generated by visible light imaging section 21 isa still image or a moving image. Note that, visible light imagingsection 21 may be omitted when inspection image 7 displayed on displaysection 32 described below (see FIG. 5A) is infrared image data to bedescribed later.

<Infrared Imaging Section>

Infrared imaging section 22 includes, by way of example, a secondoptical system (not illustrated), a second optical filter (notillustrated), and an infrared sensor (not illustrated).

The second optical system forms an image of the infrared light incidentfrom the inspection region to be an object on the infrared sensor.

The second optical filter is, in one example, a bandpass filter disposedon an optical path connecting between the second optical system and theinfrared sensor. The second optical filter transmits only infrared lightincluded in a predetermined wavelength band in the infrared light thathas passed through the optical system. The pass wavelength band of thesecond optical filter is substantially set to an absorption wavelengthband of a gas to be detected. For example, when the pass wavelength bandis set to a middle wavelength range of 3.2 to 3.4 μm, a methane gas orthe like can be detected.

The infrared sensor is, for example, a quantum indium antimonide (INSb)image sensor, a heat-type thermopile array sensor, or a microbolometer,and receives infrared light to generate infrared image data. Infraredimaging section 22 having such a configuration images an image of theinspection region in a state of being synchronized with visible lightimaging section 21 and sequentially outputs infrared image data toprocessing section 31 (specifically, image processing section 31 a).

The infrared image data generated by infrared imaging section 22 is astill image or a moving image. Such infrared image data indicates atemperature distribution in the inspection region.

<Gas Detection Device Body>

Gas detection device body 3 converts a gas generated in the inspectionregion into a visible image by using received information from imagingdevice 2. Gas detection device body 3 having this configuration is amobile terminal such as a tablet terminal, a smartphone, a laptopterminal, or a wearable terminal, which is communicably connected toimaging device 2.

Gas detection device body 3 includes, for example, processing section31, display section 32, operation input section 33, storage section 34,and control section 35.

<Processing Section>

Processing section 31 (i.e., processor) comprises at least one dedicatedhardware (an electronic circuit) in accordance with various kinds ofeach processing, such as a Digital Signal Processor (DSP), anApplication Specific Integrated Circuit (ASIC), or a Programmable LogicDevice (PLD). Processing section 31 includes, as functional blocks,image processing section 31 a, display processing section 31 b, andoutput processing section 31 c. Each function of processing section 31to be described below is realized under the control of control section35.

<Image Processing Section>

A function of image processing section 31 a will be described below. Thefunction of image processing section 31 a is realized under the controlof control section 35.

Image processing section 31 a receives infrared image data (hereinafterreferred to as “infrared image data before image processing”) in theinspection region from infrared imaging section 22. Image processingsection 31 a detects a part having a gas by performing a predeterminedimage processing on the infrared image data in the inspection region andvisualizes the detected part (hereinafter referred to as “gasvisualization processing”). Image processing section 31 a applies aspecific color (red or the like) to the part having a gas of theinfrared image data before image processing. The infrared image dataobtained after gas visualization processing is referred to as “infraredimage data after image processing”.

A method for detecting a gas from infrared image data in the inspectionregion will be briefly described. When a gas leak has occurred in theinspection region, a temperature of the part having a gas of infraredimage data in the inspection region changes (i.e., luminance of infraredimage data in the inspection region changes). Image processing section31 a detects the part having a gas based on the change in temperature.Since a method for detecting a gas is a well-known image processingmethod, it will not be described in detail.

Furthermore, image processing section 31 a receives visible image datafrom (hereinafter referred to as “visible image data before imageprocessing”) visible light imaging section 21. Image processing section31 a, then, generates inspection image data, in which the visible imagedata before image processing and the infrared image data after imageprocessing are combined. Inspection image data is displayed on thedisplay section as inspection image 7 (see FIG. 5A). Gas image 7 a (seeFIG. 5A) illustrating the gas in inspection image 7 is colored in thespecific color. Note that, the infrared image data after imageprocessing described above can be infrared image data without combiningthe visible image data.

Image processing section 31 a outputs inspection image data to displayprocessing section 31 b.

Image processing section 31 a outputs inspection image data to storagesection 34. Image processing section 31 a may outputs the infrared imagedata after image processing to storage section 34. In addition, imageprocessing section 31 a may output the visible image data before imageprocessing to storage section 34.

<Display Processing Section>

Hereinafter, a function of display processing section 31 b will bedescribed. The function of display processing section 31 b is realizedunder the control of control section 35. Display processing section 31 bhaving such a configuration controls display of display section 32 to bedescribed below.

Display processing section 31 b displays an imaging information inputimage (not illustrated) for inputting imaging information on displaysection 32. Image data to be the basis of the imaging information inputimage is prestored in storage section 34.

Display processing section 31 b converts the inspection image datareceived from image processing section 31 a into a display signalcorresponding to display section 32, and outputs the display signal todisplay inspection image 7 (see FIG. 5A) on display section 32.

Display processing section 31 b displays supplementary information inputimage 5 (see FIG. 5A) for inputting supplementary information withinspection image 7 on display section 32.

FIG. 5A illustrates examples of inspection image 7 and supplementaryinformation input image 5 displayed on display section 32. Supplementaryinformation input image 5 is, for example, an icon. Image data to be thebasis of supplementary information input image 5 is prestored in storagesection 34. Supplementary information input image 5 may be comprised ofa plurality of images to be sequentially pop-up displayed correspondingto touch operations by a user.

In one or more embodiments, supplementary information input image 5 iscomprised of first input image 51 (see FIG. 5A) always displayed ondisplay section 32 with inspection image 7, and second input image 52(see FIG. 5B) displayed on display section 32 when the user operates(e.g., by touch operation) first input image 51.

Display processing section 31 b displays second input image 52 ondisplay section 32 when first input image 51 is operated by the user. Ina case where an end instruction is input via operation input section 33while second input image 52 displayed on display section 32, displayprocessing section 31 b deletes second input image 52 from displaysection 32. Display processing section 31 b may delete second inputimage 52 after a predetermined time passes. That is, the pop-updisplayed screen as second input image 52 may be automatically deletedafter a predetermined time passes from the start of display.

When an instruction for reproduction start (hereinafter referred to as“reproduction start instruction”) is input via operation input section33, display processing section 31 b converts the inspection image datastored in storage section 34 into a display signal corresponding todisplay section 32, and outputs the display signal to display inspectionimage 7 on display section 32. In this case, display processing section31 b displays supplementary information input image 5 with inspectionimage 7 on display section 32.

Display processing section 31 b displays seek bar image 53 (see FIGS. 7Aand 7B) on display section 32 when the reproduction start instruction isinput. Image data to be the basis of seek bar image 53 is prestored instorage section 34. Seek bar image 53 enables the user to recognize areproduction status. In addition, the user can adjust a reproductionstart position by operating seek bar image 53.

Seek bar image 53 will be described with reference to FIG. 7A. First barelements 53 a (parts having slanted lattice) each mean the part beingalready reproduced in inspection image data. Furthermore, in seek barimage 53, second bar elements 53 b (hatched parts) each mean the partwhere a gas leak has been mechanically detected based on the detectionresult of image processing section 31 a.

In seek bar image 53, first mark 53 c means the part that has beenchecked by the user. In seek bar image 53, second mark 53 d means theunnecessary image data. Furthermore, in seek bar image 53, third mark 53e and fourth mark 53 f mean the parts to which supplementary informationis added by the user. Between these, third mark 53 e means the nearestsupplementary information (evidence) from reproducing position mark 53 gindicating the position under reproduction. Besides, in seek bar image53, white painted parts mean the unreproduced parts. Additionally, inseek bar image 53, black painted parts mean the deleted parts.

<Output Processing Section>

Output processing section 31 c generates output information includingthe imaging information and the inspection image data under the controlof control section 35. Output processing section 31 c generates outputinformation when an output instruction is input from operation inputsection 33.

When a range of the inspection image data is input from operation inputsection 33, output processing section 31 c extracts the inspection imagedata of the range, and generates information as output information. Notethat, output information may include inspection image data associatedwith supplementary information.

Output processing section 31 c outputs the output information to, forexample, an output device such as printer. The output device may beconnected to detection device body 3 by a wired or wireless connection.The output device also may be connected to detection device body 3 via anetwork such as the Internet. Output processing section 31 c may outputthe output information to a portable storage medium, such as an opticaldisk, a magneto-optical disk, or a memory card.

Note that, when gas detection device 1 is connected to a server via anetwork, output processing section 31 c may output the outputinformation to the server.

<Display Section>

Display section 32 is, for example, a display of a mobile terminalconstituting gas detection device body 3. As the display, a liquidcrystal display, an organic EL display, or the like can be used. In oneor more embodiments, the display is a flat panel display having a touchpanel.

Display section 32 displays various images based on the display signalsfrom display processing section 31 b under the control of controlsection 35. On display section 32, inspection image 7 for the user tovisually detect a gas, supplementary information input image 5 for theuser to input the supplementary information, and seek bar image 53 forthe user to recognize a reproduction status of the inspection image dataand/or the like are displayed (see FIGS. 5A to 7A).

<Operation Input Section>

Operation input section 33 (i.e., input interface) is an input sectionthat receives, for example, input of imaging information and input ofsupplementary information. Operation input section 33 also receives anoperation relating to reproduction of the inspection image data and anoperation relating to imaging of imaging device 2. Note that, imaginginformation includes various pieces of information required to startimaging by imaging device 2. Imaging information will be describedbelow.

Operation input section 33 receives an output instruction. Operationinput section 33 may receive, for example, designation of items to beincluded in the output information, together with the outputinstruction. The items of the output information include imaginginformation described below and any other information (e.g., weatherinformation during imaging).

Operation input section 33 may receive designation of a range of theinspection image data to be output as output information. The user, byway of example, designates the range of the inspection image data to beoutput from seek bar image 53 (see FIG. 7A) displayed on display section32.

Operation input section 33 may permit receiving input of the outputinstruction only when imaging information corresponding to theinspection region to be imaged is input (i.e., when the imaginginformation is stored in storage section 34).

Conversely, operation input section 33 may reject receiving input of theoutput instruction when imaging information corresponding to theinspection region to be imaged is not input (i.e., when the imaginginformation is not stored in storage section 34).

Furthermore, operation input section 33 may permit receiving input ofthe output instruction only when supplementary information associatedwith the inspection image data is input (i.e., when the supplementaryinformation is stored in storage section 34).

Conversely, operation input section 33 may reject receiving input of theoutput instruction when supplementary information associated with theinspection image data is not input (i.e., when the supplementaryinformation is not stored in storage section 34).

In other words, operation input section 33 may permit receiving input ofthe output instruction only when the imaging information correspondingto the inspection region to be imaged and the supplementary informationassociated with the inspection image data are input.

In one or more embodiments, operation input section 33 comprises a flatpanel display with a touch panel that is integrally provided withdisplay section 32. The user can input imaging information, inputsupplementary information, operate imaging device 2, and performreproducing operations of the inspection image data via operation inputsection 33.

Operation input section 33 is not limited to a flat display with a touchpanel, and may be, for example, an input device such as a keyboard, amouse, or a microphone instead.

<Control Section>

Control section 35 (i.e., controller) includes Central Processing Unit(CPU) 35 a as a calculation/control device, Random Access Memory (RAM)35 b and Read Only Memory (ROM) 35 c as a main storage device. ROM 35 cstores basic programs and basic setting data. CPU 35 a reads outprograms corresponding to processing contents from ROM 35 c or storagesection 34, loads the programs into RAM 35 b, and performs centralizedcontrol of operations of the respective blocks of gas detection device 1by executing the loaded programs. Control section 35 having such aconfiguration controls imaging device 2, display section 32, operationinput section 33, and storage section 34 depending on their functionsand thereby controls the entire gas detection device 1.

In one or more embodiments, functions of each functional block can berealized by the cooperation of each hardware constituting the functionalblocks and control section 35. Note that, a part or all of the functionsof each functional block may be realized by execution of the programs bycontrol section 35.

<Storage Section>

Storage section 34 (i.e., storage) is, for example, an auxiliary storagedevice such as a nonvolatile semiconductor memory (a so-called flashmemory) or a hard disk drive. Storage section 34 may be a disk drive forreading and writing information by driving an optical disk such as aCompact Disc (CD) or a Digital Versatile Disc (DVD), or aMagneto-Optical Disk (MO). In addition, for example, storage section 34may be a memory card such as a USB memory or an SD card.

Storage section 34 stores the imaging information input from operationinput section 33. Writing of data into storage section 34 and reading ofdata from storage section 34 are controlled by control section 35.

Storage section 34 stores the inspection image data received from imageprocessing section 31 a. Storage section 34 stores the inspection imagedata in association with the imaging information.

Storage section 34 may store the infrared image data after imageprocessing received from image processing section 31 a. Storage section34 may store the infrared image data in association with the imaginginformation.

Storage section 34 may store the infrared image data before imageprocessing generated by infrared imaging section 22. Storage section 34may store the infrared image data before image processing in associationwith the imaging information.

Storage section 34 may store the visible image data generated by visiblelight imaging section 21. Storage section 34 may store the visible imagedata in association with the imaging information.

Storage section 34 stores various pieces of information input fromoperation input section 33. In particular, storage section 34 stores thesupplementary information input from operation input section 33. Storagesection 34 stores the supplementary information in association withinspection image 7 (see FIG. 5A) displayed on display section 32 whenthe supplementary information is input. When inspection image 7 is amoving image, storage section 34 stores the supplementary information inassociation with a frame constituting inspection image 7 (see FIG. 5A)displayed on display section 32 when the supplementary information isinput.

Storage section 34 stores image data relating to supplementaryinformation input image 5. Storage section 34 also stores image datarelating to seek bar image 53. The image data relating to seek bar image53 include image data relating to first bar element 53 a, second barelement 53 b, and first mark 53 c to fourth mark 53 f described above.

<Exemplary Operation>

Next, an exemplary operation of gas detection device 1 according to oneor more embodiments of the present invention will be described withreference to FIGS. 2 to 4 . FIG. 2 is a flowchart illustrating anexemplary imaging flow of gas detection device 1. FIG. 3 is a flowchartillustrating an exemplary reproduction flow of gas detection device 1.FIG. 4 is a flowchart illustrating an exemplary output flow of gasdetection device 1.

<Imaging Flow>

An operation of gas detection device 1 when the user inputs thesupplementary information at any timing during imaging by gas detectiondevice 1 will be described with reference to FIGS. 1, 2, 5A, and 5B.Imaging by gas detection device 1 is performed while gas detectiondevice 1 is placed in a predetermined position from where the inspectionregion including the inspection target can be imaged. Gas detectiondevice 1 is placed in, for example, a predetermined position in asupported state by a tripod.

When an imaging start instruction is input from operation input section33, gas detection device 1 starts the imaging flow illustrated in FIG. 2. The processing described below realized, for example, by CPU 35 aexecuting a predetermined program stored in ROM 35 c (see FIG. 1 ) afterthe imaging start instruction is input in gas detection device 1.

In step S101 in FIG. 2 , display processing section 31 b displays animaging information input image (not illustrated) for inputting imaginginformation on display section 32 under the control of control section35. In other words, in step S101 in FIG. 2 , gas detection device 1requests the user to input imaging information.

In step S101 in FIG. 2 , imaging information requested to the user bygas detection device 1 is, in one example, the information illustratedin table 1.

TABLE 1 User Info Customer ID User ID Inspector(Name)Inspector(Company/Dept) Inspection Info Inspection Date Inspection TypeSite Info Site Name Facility Info Facility Name AIRS ID GPS(Latitude,Longitude) of the Facility

In step S101 in FIG. 2 , in a case where an inspection region to beimaged has been imaged in the past, control section 35 may obtain theimaging information from imaging history. The imaging history is storedin storage section 34. Such imaging information is stored in associationwith the inspection region in storage section 34.

In step S102 in FIG. 2 , control section 35 determines the presence orabsence of input of imaging information (including the imaginginformation from the imaging history).

In step S102, when it is determined that no imaging information is input(“NO” in step S102), control processing shifts to step S101. Bycontrast, in step S102, when it is determined that imaging informationis input (“YES” in step S102), control processing shifts to step S103.Note that, the determination in step S102 may be omitted as a modifiedexample of the flowchart illustrated in FIG. 2 . That is, the controlprocessing may shift to step S103 regardless of whether the imaginginformation is input in step S101.

In step S103 in FIG. 2 , imaging device 2 starts imaging of theinspection region under the control of control section 35. Imagingdevice 2 sequentially outputs visible image data to processing section31 (specifically image processing section 31 a) during imaging. Inaddition, imaging device 2 sequentially outputs infrared image data toprocessing section 31 (specifically image processing section 31 a)during imaging. The visible image data and the infrared image datagenerated by imaging device 2 may be stored in storage section 34.

During imaging by imaging device 2, image processing section 31 areceives infrared image data from infrared imaging section 22. Then,image processing section 31 a performs the gas visualization processingdescribed above on the received infrared image data to generate infraredimage data after image processing.

During imaging by imaging device 2, image processing section 31 areceives visible image data from visible light imaging section 21. Then,image processing section 31 a generates inspection image data in whichthe received visible image data is combined with the infrared image dataafter image processing.

Image processing section 31 a sequentially outputs the generatedinspection image data to display processing section 31 b during imagingby imaging device 2. Display processing section 31 b converts thereceived inspection image data into a display signal corresponding todisplay section 32, and outputs the display signal to display inspectionimage 7 (see FIG. 5A) on display section 32. Thus, during imaging byimaging device 2, inspection image 7 of the inspection image isdisplayed in real time on display section 32.

Note that, when gas detection device 1 is connected to a server via anetwork, display processing section 31 c may transmit inspection image 7to the server. Inspection image 7 received in the server may bedisplayed on a display section (e.g., a display) connected to the server(including a connection via a network). Such a configuration allows aperson other than a person who took the image to visually recognizeinspection image 7 of the inspection region from a remote place in realtime. Gas detection device 1 may also be configured so that the otherperson can input the supplementary information described below from theremote place.

In addition, display processing section 31 b always displayssupplementary information input image 5 (particularly first input image51) for inputting supplementary information on display section 32 duringimaging by imaging device 2.

In step S104 in FIG. 2 , control section 35 determines the presence orabsence of an input instruction of supplementary information. Thepresence or absence of an input instruction is determined, for example,whether first input image 51 is touch-operated by the user.

In step S104, when it is determined that no input of supplementaryinformation is instructed (“NO” in step S104), control processing shiftsto step S106. By contrast, in step S104, when it is determined thatinput of supplementary information is instructed (“YES” in step S104),control processing shifts to step S105.

In step S105 in FIG. 2 , display processing section 31 b displays secondinput image 52 on display section 32 (see FIG. 5B) under the control ofcontrol section 35. The user, in step S105, inputs the supplementaryinformation from second input image 52 displayed on display section 32.Specifically, the user, in step S105, inputs the displayed supplementaryinformation related to inspection image 7 from second input image 52while inspection image 7 is displayed on display section 32. Theprocessing of gas detection device 1 in step S105 may be referred to assupplementary information input processing.

FIG. 5B illustrates a screen of display section 32 on which second inputimage 52 is displayed. Second input image 52 includes importance inputsection 52 a and comment input section 52 b. The user can optionallyinput information related to importance of inspection image 7 displayedon display section 32 to importance input section 52 a. The informationrelated to importance includes, for example, the terms “important”,“normal”, or “unnecessary”.

Furthermore, the user can input any comment related to inspection image7 displayed on display section 32 to comment input section 52 b. Thecomment includes, for example, a comment related to a gas leak, such as“Gas leak is occurring”. The information related to importance and thecomment as described above are supplementary information.

Note that, importance input section 52 a may be an input section havinga multiple-choice system, such as importance input section 52 cillustrated in FIG. 6A. In addition, importance input section 52 b maybe an input section having a multiple-choice system, such as importanceinput section 52 d illustrated in FIG. 6B.

In importance input section 52 d illustrated in FIG. 6B, displayprocessing section 31 b obtains options of the comment (also referred toas “supplementary information candidates”) from storage section 34, anddisplays on comment input section 52 b of display section 32. The optionof the comment may be, for example, information related to gas leakstatus information or regulation, which is prestored in storage section34.

The option of the comment may also be, for example, the comment that hasbeen input in the past by the user. Furthermore, the option of thecomment may change depending on inspection image 7 displayed on displaysection 32. By way of example, the option of the comment may bedetermined based on the learning result that has been obtained byArtificial Intelligence (AI) learning the relationship between thecomment that has been input in the past by the user and inspection image7 having the comment.

In step S105, when the supplementary information is input, controlsection 35 stores in the storage section 34 the inspection image datathat has been displayed on display section 32 (specifically, the frameconstituting inspection image) in association with the supplementaryinformation. The inspection image data to be associated with thesupplementary information is the inspection image data displayed ondisplay section 32 while second input image 52 is displayed on displaysection 32.

The inspection image data to be associated with the supplementaryinformation may only be the inspection image data displayed on displaysection 32 at the timing when second input image 52 is displayed ondisplay section 32 (the timing when first input image 51 on displaysection 32 illustrated in FIG. 5A is operated).

Note that, in supplementary information input processing in step S105,the range of the inspection image data to be associated with thesupplementary information may be designated by a selecting operation bythe user.

In step S106 in FIG. 2 , control section 35 determines the presence orabsence of an imaging completion instruction. The imaging completioninstruction is input from operation input section 33 by the user.

In step S106, when it is determined that no instruction to end imagingis input (“NO” in step S106), control processing shifts to step S104. Bycontrast, in step S106, when it is determined that an instruction to endimaging is input (“YES” in step S106), control processing shifts to stepS107.

In step S107, control section 35 ends imaging by imaging device 2. Thus,the control processing ends.

<Reproduction Flow>

An operation of gas detection device 1 when the user inputs thesupplementary information at any timing during reproduction of theinspection image data stored in storage section 34 will be describedwith reference to FIGS. 1, 3, 7A, and 7B.

When a reproduction start instruction is input from operation inputsection 33, gas detection device 1 starts the reproduction flowillustrated in FIG. 3 . The processing described below is realized, forexample, by CPU35 a executing a predetermined program stored in ROM 35 cafter the reproduction start instruction is input in gas detectiondevice 1.

In step S201 in FIG. 3 , display processing section 31 b obtainsinspection image data from storage section 34 under the control ofcontrol section 35. Display processing section 31 b converts theobtained inspection image data into a display signal corresponding todisplay section 32, and outputs the display signal to display inspectionimage 7 on display section 32. Thus, the inspection image data stored instorage section 34 is displayed on display section 32.

Display processing section 31 b always displays supplementaryinformation input image 5 (particularly first input image 51) forinputting supplementary information on display section 32 (see FIG. 7A)during reproduction of the inspection image data.

Further, display processing section 31 b always displays seek bar image53 (see FIG. 7A) on display section 32 during reproduction of theinspection image data.

In step S202 in FIG. 3 , control section 35 determines the presence orabsence of an input instruction of supplementary information. Thepresence or absence of an input instruction is determined, for example,whether first input image 51 is touch-operated by the user.

In step S202, when it is determined that no input of supplementaryinformation is instructed (“NO” in step S202), control processing shiftsto step S204. By contrast, in step S202, when it is determined thatinput of supplementary information is instructed (“YES” in step S202),control processing shifts to step S203.

In step S203 in FIG. 3 , display processing section 31 b displays secondinput image 52 on display section 32 (see FIG. 7B) under the control ofcontrol section 35. The user, in step S203, inputs the supplementaryinformation from second input image 52 displayed on display section 32.Specifically, the user, in step S203, inputs the reproducing displayedsupplementary information related to inspection image 7 from secondinput image 52 while inspection image 7 is reproducing displayed ondisplay section 32. The processing of gas detection device 1 in stepS203 may be referred to as supplementary information input processing.Since the supplementary information input processing is the same as theabove imaging flow, a description thereof is omitted.

In step S203, when the supplementary information is input, controlsection 35 stores in storage section 34 the inspection image data thathas been displayed on display section 32 (specifically, the frameconstituting inspection image) in association with the supplementaryinformation. The inspection image data to be associated with thesupplementary information is the inspection image data displayed ondisplay section 32 while second input image 52 is displayed on displaysection 32.

In addition, when the supplementary information is input, displayprocessing section 31 b controls display section 32 so as toadditionally display third mark 53 e indicating the position where thesupplementary information is added in the inspection image data on seekbar image 53.

Note that, during reproduction of the inspection image data, displayprocessing section 31 b may display a content of the supplementaryinformation on display section 32 when the reproducing position in seekbar image 53 (i.e., reproducing position mark 53 g) and the position ofthe supplementary information that has been input (e.g., third mark 53e) approach to a predetermined range.

Furthermore, display processing section 31 b controls display section 32so as to end displaying the content of supplementary information whenthe reproducing position in seek bar image 53 (i.e., the positon ofreproducing position mark 53 g in seek bar image 53) separates by apredetermined distance from third mark 53 e.

In step S204 in FIG. 3 , control section 35 determines the presence orabsence of a reproduction completion instruction. The reproductioncompletion instruction is input from operation input section 33 by theuser.

In step S204, when it is determined that no instruction to endreproduction is input (“NO” in step S204), control processing shifts tostep S202. By contrast, in step S204, when it is determined that aninstruction to end reproduction is input (“YES” in step S204), controlprocessing shifts to step S205.

In step S205, control section 35 ends reproduction. Thus, the controlprocessing ends.

<Output Flow>

An operation of gas detection device 1 when generating outputinformation and outputting the output information will be described withreference to FIG. 4 .

When an output instruction is input from operation input section 33, gasdetection device 1 starts the output flow illustrated in FIG. 4 . Theprocessing described below is realized, for example, by CPU 35 aexecuting a predetermined program stored in ROM 35 c after the outputinstruction is input in gas detection device 1.

In step S301 in FIG. 4 , control section 35 determines the presence orabsence of imaging information.

In step S301, when it is determined that no imaging information is input(“NO” in step S301), the control processing ends. That is, gas detectiondevice 1 prohibits generating output information in a case where noimaging information is input even when an output instruction has beeninput.

By contrast, in step S301, when it is determined that imaginginformation is input (“YES” in step S301), control processing shifts tostep S302.

In step S302 in FIG. 4 , output processing section 31 c generates outputinformation including the imaging information and the inspection imagedata under the control of control section 35. Note that, the outputinformation may include information other than the imaging informationand the image data. The user can designate information included in theoutput information via operation control section 33.

In step S302, output processing section 31 c may generate outputinformation by extracting the inspection image data associated with thesupplementary information from the inspection image data. In otherwords, the output information may include the inspection image dataassociated with the supplementary information in the inspection imagedata.

In step S302, the user may designate a range of the inspection imagedata to be extracted as output information from operation input section33. In this case, the output information includes the inspection imagedata corresponding to the range in the inspection image data.

Note that, the imaging information that is included in the outputinformation generated in step S302 may include at least, for example,the items listed in the above Table 1.

In step S303 in FIG. 4 , output processing section 31 c outputs theoutput information to the output terminal (e.g., a printer) designatedby the user or the storage medium (portable storage medium such as anoptical disk, a magneto-optical disk, or a memory card) under thecontrol of control section 35. Output processing section 31 c mayautomatically attach the output information to a certificate (acertificate file) related to the inspection target. The controlprocessing of output flow then ends.

Functions and Effects

Using gas detection device 1 according to the embodiments describedabove, the user can input any supplementary information at any timing,while visually recognizing inspection image 7 displayed on displaysection 32 during imaging and reproduction by gas detection device 1.Such supplementary information is stored in storage section 34 inassociation with inspection image 7 displayed on display section 32 whenthe supplementary information is input. The user can distinguish betweenan important part and an unimportant part in inspection image 7 byadding the supplementary information. In addition, the user candistinguish between an important part and an unimportant part ininspection image 7 by giving a meaning to inspection image 7 using thesupplementary information. As a result, for example, data volume can bereduced by deleting the unimportant part from the inspection image datawhen inspection image 7 is stored. Furthermore, when the user checksinspection image 7 later, efficiency of checking operation can beimproved by mainly checking the part having the supplementaryinformation in inspection image 7. Moreover, when the output informationis generated to output, data volume of the output information can bereduced, and efficiency of checking operation of the output informationcan be improved by extracting, as the output information, the inspectionimage data to which the supplementary information has been added.

Other Embodiments

Next, gas detection device 1 according to one or more embodiments of thepresent invention will be described with reference to the drawings. Gasleakage detector 1 disclosed in PTL 1 allows an inspector to visuallyidentify with ease a gas leak spot in an inspection region by visuallyrecognizing an inspection image displayed on a display section.Incidentally, for the inspector, the importance of an inspection imagein a normal time when an inspection target has no gas leak issignificantly different from that of an inspection image in an emergencytime when an inspection target has a gas leak. By way of example, theinspector needs to partially visually recognize only the inspectionimage in the emergency time while needing to continuously visuallyrecognize the inspection image in a predetermined time including theinspection image in the normal time and the inspection image in theemergency time. However, the gas leakage detector disclosed in PTL 1does not have a configuration satisfying such necessity.

FIG. 8 is a block diagram of gas detection device 1 according to one ormore embodiments. Gas detection device 1, for example, images aninspection region including an inspection target (e.g., a plant) in gasproduction facility. Then, gas detection device 1 performs imageprocessing to detect a gas on the imaged data.

<Gas Detection Device>

As illustrated in FIG. 8 , gas detection device 1 according to one ormore embodiments of the present invention includes imaging device 2 andgas detection device body 3. Hereinafter, the configuration that isdifferent from imaging device 2 and gas detection device body 3 includedin gas detection device 1 according to the above embodiments will bemainly described. The same reference signs are used for the sameconfigurations, and thus, a description thereof is omitted.

The infrared sensor used for a second optical system of imaging device 2is, for example, a quantum indium antimonide (INSb) image sensor, aheat-type thermopile array sensor, or a microbolometer, and receivesinfrared light to generate infrared image data. Infrared imaging section22 having such a configuration images an inspection region including aninspection target (e.g., plant 6 a in FIG. 9A) and sequentially outputsinfrared image data to processing section 31 (specifically, imageprocessing section 31 a).

<Gas Detection Device Body>

Gas detection device body 3 includes, for example, processing section31, display section 32, operation input section 33, storage section 34,and control section 35.

<Processing Section>

Processing section 31 comprises at least one dedicated hardware (anelectronic circuit) in accordance with a various kind of processing,such as a Digital Signal Processor (DSP), an Application SpecificIntegrated Circuit (ASIC), or a Programmable Logic Device (PLD).

Processing section 31 includes, as functional blocks, image processingsection 31 a, display processing section 31 b, and output processingsection 31 c, and time information generating section 31 d. Eachfunction of processing section 31 to be described below is realizedunder the control of control section 35.

<Image Processing Section>

Hereinafter, a function of image processing section 31 a will bedescribed.

Image processing section 31 a receives infrared image data in theinspection region from infrared imaging section 22.

Image processing section 31 a performs a predetermined image processingon the infrared image data in the inspection region to detect a parthaving a gas.

Image processing section 31 a, for example, detects a part having a gasfrom the infrared image data and generates gas image data by visualizingthe detected part. A well-known method can be used for detecting thepart having a gas. Image processing section 31 a applies a specificcolor (red or the like) to the part having a gas of the infrared imagedata. Image processing section 31 a corresponds to “gas detectionsection.”

Image processing section 31 a receives visible image data from visiblelight imaging section 21. Image processing section 31 a, then, generatesinspection image data in which the visible image data is combined withthe gas image data. Image processing section 31 a also generatestemperature image data from the infrared image data. Image processingsection 31 a may generate inspection image data in which the infraredimage data is combined with the gas image data.

Image processing section 31 a outputs the inspection image data to imageprocessing section 31 b and storage section 34. Storage section 34stores the inspection image data in association with a time of imagingof the infrared image data to be the basis of the inspection image data.More specifically, storage section 34 stores the inspection image datain association with detection time information indicating the time whena gas is detected by image processing section 31 a. Detection timeinformation will be described below in detail.

Inspection image data is displayed on display section 32 as inspectionimage 7 (see FIG. 9A). Gas image 7 a (see FIG. 9A) illustrating the gasin inspection image 7 is colored in the specific color.

<Display Processing Section>

Hereinafter, a function of display processing section 31 b will bedescribed. The function of display processing section 31 b is realizedunder the control of control section 35. Display processing section 31 bhaving such a configuration controls display of display section 32 to bedescribed below.

Display processing section 31 b displays an imaging information inputimage (not illustrated) for inputting imaging information on displaysection 32. The imaging information includes various pieces ofinformation required to start imaging by imaging device 2. By way ofexample, the imaging information includes; customer Identification (ID),user ID, inspector (Name), inspector (Company/Dept), inspection date,inspection type, site name, facility name, facility ID, latitude andlongitude of the facility positioned by Global Positioning System (GPS),and/or the like. Image data to be the basis of the imaging informationinput image is prestored in storage section 34.

Display processing section 31 b converts the inspection image datareceived from image processing section 31 a into a display signalcorresponding to display section 32, and outputs the display signal todisplay inspection image 7 (see FIG. 9A) on display section 32.

Display processing section 31 b displays supplementary information inputimage 5 (see FIG. 9A) for inputting supplementary information related toinspection image 7 on display section 32 with inspection image 7. Thesupplementary information includes information related to importance ofand a comment on inspection image 7 displayed on display section 32. Theinformation related to importance includes, for example, the terms“important”, “normal”, or “unnecessary”. The comment includes, forexample, comment related to a gas leak, such as “Gas leak is occurring”.

FIG. 9A illustrates examples of inspection image 7 and supplementaryinformation input image 5 displayed on display section 32. Informationinput image 5 is, for example, an icon. Image data to be the basis ofsupplementary information input image 5 is prestored in storage section34. Supplementary information input image 5 may be comprised of aplurality of images to be sequentially pop-up displayed respectively forinput items corresponding to touch operations by a user.

In one or more embodiments, supplementary information input image 5 iscomprised of first input image 51 (see FIG. 9A) always displayed ondisplay section 32 with inspection image 7, and second input image 52(see FIG. 9B) displayed on display section 32 when the user operates(e.g., by touch operation) first input image 51.

Display processing section 31 b displays second input image 52 ondisplay section 32 when first input image 51 is operated by the user.Second input image 52 includes importance input section 52 a and commentinput section 52 b. The user can optionally input information related toimportance of inspection image 7 displayed on display section 32 toimportance input section 52 a. Furthermore, the user can input a commentrelated to inspection image 7 displayed on display section 32 to commentinput section 52 b. Note that, importance input section 52 a may be aninput section in which input items selectively displayed in a pull-downsystem, such as importance input section 52 c illustrated in FIG. 10A.Comment input section 52 b may be an input section in which input itemsselectively displayed in a pull-down system, such as importance inputsection 52 d illustrated in FIG. 10B.

The time when first input image 51 is operated is stored in storagesection 34 in association with the image that is imaged by imagingdevice 2 and time information of inspection image 7. The supplementaryinformation may be stored during reproduction as well as duringrecording.

In a case where OK button 52 e is pressed via operation input section 33while second input image 52 is displayed on display section 32, displayprocessing section 31 b deletes second input image 52 from displaysection 32. Display processing section 31 b may delete second inputimage 52 after a predetermined time passes from the start of pop-updisplay of second input image 52.

When an instruction for reproduction start (hereinafter referred to as“reproduction start instruction”) is input via operation input section33, display processing section 31 b converts the inspection image datastored in storage section 34 into a display signal corresponding todisplay section 32, and outputs the display signal to display inspectionimage 7 on display section 32. In this case, display processing section31 b displays supplementary information input image 5 with inspectionimage 7 on display section 32.

<Output Processing Section>

Output processing section 31 c generates output information includingthe inspection image data under the control of control section 35.Output processing section 31 c generates output information when anoutput instruction is input from operation input section 33.

Output processing section 31 c outputs the output information to, forexample, an output device such as printer. The output device may beconnected to detection device body 3 by a wired or wireless connection.The output device also may be connected to detection device body 3 via anetwork such as the Internet. Output processing section 31 c may outputthe output information to a portable storage medium, such as an opticaldisk, a magneto-optical disk, or a memory card.

Note that, when gas detection device 1 is connected to a server via anetwork, output processing section 31 c may output the outputinformation to the server.

<Control Section>

Control section 35 includes Central Processing Unit (CPU) 35 a as acalculation/control device, Random Access Memory (RAM) 35 b and ReadOnly Memory (ROM) 35 c as a main storage device. ROM 35 c stores basicprograms and basic setting data. CPU 35 a reads out programscorresponding to processing contents from ROM 35 c or storage section34, loads the programs into RAM 35 b, and performs centralized controlof operations of the respective blocks of gas detection device 1 byexecuting the loaded programs. Control section 35 having such aconfiguration controls imaging device 2, display section 32, operationinput section 33, and storage section 34 depending on their functionsand thereby controls the entire gas detection device 1.

In one or more embodiments, functions of each functional block can berealized by the cooperation of each hardware constituting the functionalblocks and control section 35. Note that, a part or all of the functionsof each functional block may be realized by execution of the programs bycontrol section 35.

Control section 35 determines reliability of the gas detection based onsignals from temperature sensor 81, wind speed sensor 82 and peripheralsensor 8 of vibration sensor 83. Temperature sensor 81 measures anambient temperature around gas detection device 1. Wind speed sensor 82measures wind speed around gas detection device 1 or the inspectiontarget. The wind speed can be obtained as wind speed information aroundthe imaging spot using a network. Vibration sensor 83 measures avibration state of imaging device 2. Control section 35 determines thereliability of the gas detection is low in cases where: a difference intemperature between the temperature indicated by the inspection image ofthe inspection region imaged by infrared imaging section 22 and thetemperature indicated by temperature sensor 81 is lower than or equal toa predetermined temperature; a wind speed indicated by wind speed sensor82 is greater than or equal to a predetermined value; and a valueindicated by vibration sensor 83 is greater than or equal to apredetermined value. Control section 35, then, determines the gasdetection information obtained by the image processing in this time slotis invalid in these cases. Control section 35 stores in storage section34 the time information of inspection image 7 and the invalidinformation in association with each other.

<Storage Section>

Storage section 34 is, for example, an auxiliary storage device such asa nonvolatile semiconductor memory (a so-called flash memory) or a harddisk drive. Storage section 34 may be a disk drive for reading andwriting information by driving an optical disk such as a Compact Disc(CD) or a Digital Versatile Disc (DVD), or a Magneto-Optical Disk (MO).In addition, for example, storage section 34 may be a memory card suchas a USB memory or an SD card.

Storage section 34 stores the imaging information input from operationinput section 33. Writing of data into storage section 34 and reading ofdata from storage section 34 are controlled by control section 35.

Storage section 34 stores the inspection image data received from imageprocessing section 31 a. Storage section 34 stores the inspection imagedata in association with the imaging information. Storage section 34stores the inspection image data in association with the detection timeinformation indicating the time when a gas is detected by imageprocessing section 31 a.

Storage section 34 may store the infrared image data after imageprocessing received from image processing section 31 a. Storage section34 may store the infrared image data after image processing inassociation with the imaging information. Storage section 34 may storethe infrared image data after image processing in association with thedetection time information.

Storage section 34 may store the infrared image data before imageprocessing generated by infrared imaging section 22. Storage section 34may store the infrared image data before image processing in associationwith the imaging information. Storage section 34 may store the infraredimage data before image processing in association with the detectiontime information.

Storage section 34 may store the visible image data generated by visiblelight imaging section 21. Storage section 34 may store the visible imagedata in association with the imaging information. Storage section 34 maystore the visible image data in association with the detection timeinformation.

Storage section 34 may store the temperature image data. Storage section34 may store the temperature image data in association with thedetection time information.

Storage section 34 stores various pieces of information input fromoperation input section 33. In particular, storage section 34 stores thesupplementary information input from operation input section 33. Storagesection 34 stores the supplementary information in association withinspection image 7 (see FIG. 11A) displayed on display section 32 whenthe supplementary information is input. When inspection image 7 is amoving image, Storage section 34 stores the supplementary information inassociation with a frame constituting inspection image 7 displayed ondisplay section 32 when the supplementary information is input. Thesupplementary information may be stored in association with the infraredimage data after image processing, the infrared image data before imageprocessing the visible image data or the temperature image data,individually.

In addition, the information related to the reliability of the gasdetection is stored in association with the image data. The informationrelated to the reliability of the gas detection may be stored inassociation with the infrared image data after image processing, theinfrared image data before image processing the visible image data orthe temperature image data, individually.

Storage section 34 stores image data related of supplementaryinformation input image 5.

<Display Section>

Display section 32 is, for example, a display of a mobile terminalconstituting gas detection device body 3. As the display, a liquidcrystal display, an organic EL display, or the like can be used. In oneor more embodiments, the display is a flat panel display having a touchpanel.

Display section 32 displays various kinds of images based on the displaysignals from display processing section 31 b (see FIG. 8 ) under thecontrol of control section 35. Specifically, display section 32 displaysinspection image 7 for the user to visually detect a gas (see FIG. 9A)and the like.

<Operation Input Section>

Operation input section 33 is an input section that receives, forexample, input of imaging information. Operation input section 33 alsoreceives an operation relating to reproduction of the inspection imagedata and an operation relating to imaging of imaging device 2.

Operation input section 33 receives an output instruction related toimaging. Operation input section 33 may receive, for example,designation of items to be included in the output information, togetherwith the output instruction. The items of the output information includeimaging information and any other information (e.g., weather informationduring imaging).

In one or more embodiments, operation input section 33 comprises a flatpanel display with a touch panel that is integrally provided withdisplay section 32. The user can input imaging information, operateimaging device 2, and perform reproducing operations of the inspectionimage data via operation input section 33.

Operation input section 33 is not limited to a flat display with a touchpanel, and may be, for example, an input device such as a keyboard, amouse, or a microphone instead.

According to gas detection device 1 described above, when a gas isdetected in an inspection region, a gas detection report is prepared andsubmitted to a requester (a client). For preparation of the report, theinspection image data is reproduced to confirm the inspection image.When a reproduction start instruction is input via operation inputsection 33, display processing section 31 b converts the inspectionimage data read out from storage section 34 into a display signalcorresponding to display section 32, and then outputs the display signalto display inspection image 7 (see FIG. 9A) on display section 32. Theuser (the inspector) identifies specifies, for example, a gas leak spotin the inspection region, gas leak occurrence time, and a situationafter occurrence of the gas leak by visually recognizing inspectionimage 7.

Incidentally, for the user, the importance of an inspection image in anormal time when an inspection target has no gas leak is significantlydifferent from that of an inspection image in an emergency time when aninspection target has a gas leak. By way of example, the inspector needsto partially visually recognize only the inspection image in theemergency time while needing to continuously visually recognize theinspection image in a predetermined time including the inspection imagein the normal time and the inspection image in the emergency time. Thatis, the user requires to visually recognize inspection image 7effectively in accordance with user's own desire.

Thus, in one or more embodiments, when a reproduction start instructionis input, display processing section 31 b converts the inspection imagedata read out from storage section 34 into a display signalcorresponding to display section 32, and then outputs the display signalto display inspection image 7 on display section 32. In this case,display processing section 31 b displays seek bar image 53 (see FIG.11A) visualizing a display position on a time axis with inspection image7 on display section 32.

Image data to be the basis of seek bar image 53 is prestored in storagesection 34. In FIGS. 11A and 11B, as components of seek bar image 53,first bar element 53 a, second bar element 53 b, third bar element 53 p,fourth bar element 53 q, fifth bar element 53 r, and sixth bar element53 s. First bar element 53 a means time when no gas is detected. Secondbar element 53 b means time when a gas is detected by image processingsection 31 a. Third bar element 53 p means a part where inspection imagedata are absent or deleted. Fourth bar element 53 q means an invalidpart of the inspection image data. Fifth bar element 53 r means areproduced part of inspection image 7. Sixth bar element 53 s means anunreproduced part of inspection image 7. Note that, second bar element53 b corresponds to “detection time information.”

Hereinafter, a function of time information generating section 31 d willbe described. The function of time information generating section 31 dis realized under the control of control section 35.

Time information generating section 31 d generates image data to be thebasis of first bar element 53 a and second bar element 53 b based on thetime when the infrared image data to be the basis of the inspectionimage data is imaged. Time information generating section 31 d generatesimage data to be the basis of fourth bar element 53 q based on thereliability information stored in storage section 34.

Time information generating section 31 d generates fifth bar element 53r and sixth bar element 53 s according to the reproduced part ofinspection image 7.

Display processing section 31 b displays first bar element 53 a, secondbar element 53 b, third bar element 53 p, fourth bar element 53 q, fifthbar element 53 r, and sixth bar element 53 s on display section 32,being reflected in seek bar image 53.

Another element to be displayed, being reflected in seek bar image 53will be described with reference to FIGS. 11A and 11B. In the followingdescription, each mark of first mark 53 c to fourth mark 53 f isreferred to as evidence mark. The evidence mark is displayed on seek barimage 53. A position where the evidence mark is displayed indicates time(reception time information) when input of the supplementary informationis received. The evidence mark is a part indicating the supplementaryinformation added by the user.

Display processing section 31 b emphatically displays (for example,display in bold or highlighted) third mark 53 e, which is located onafter reproducing position mark 53 g (see FIG. 11A, also referred to asa “slider”) indicating a position where the inspection image isreproduced, and which is the nearest mark from reproducing position mark53 g. In a case where third mark 53 e is emphatically displayed, timeinformation generating section 31 d generates selection rangeinformation 53 h indicating the time slot selected in accordance withthird mark 53 e.

Specifically, time information generating section 31 d generates, asselection range information 53 h, a certain time (a time slot) startingfrom a position prior to and apart from third mark 53 e by apredetermined time to a position later than and apart from third mark 53e by a predetermined time.

In FIGS. 11A and 11B, fifth mark 53 i means a front of selection rangeinformation 53 h. Sixth mark 53 j means a rear of selection rangeinformation 53 h. The user can optionally change selection rangeinformation 53 h by moving positions of fifth mark 53 i or sixth mark 53j via operation input section 33.

Another element to be displayed, being reflected in seek bar image 53will be described with reference to FIG. 11A. First mark 53 c to bedisplayed, being reflected in seek bar image 53 means a part to whichsupplementary information having high importance is added. Second mark53 d means a part to which supplementary information having lowimportance is added. Third mark 53 e and fourth mark 53 f mean a part towhich other supplementary information is added.

As illustrated in FIGS. 11A and 11B, selection range information 53 hincludes third mark 53 e. In FIGS. 11A and 11B, third mark 53 e isselected, and selection range information 53 h corresponding to thirdmark 53 e is displayed. When fourth mark 53 f is selected, selectionrange information corresponding to fourth mark 53 f (not illustrated) isdisplayed.

When designation of third mark 53 e (or fourth mark 53 f) is input fromoperation section 33, output processing section 31 c generates thesupplementary information related to third mark 53 e (or fourth mark 53f) as output information and outputs the supplementary information toanother device. The other device includes: for example, a local folderof a Personal Computer (PC) or a flash memory such as an SD card in acase where gas detection device 1 is connected to a PC via a network, anoutput device such as a server or a printer in a case where gasdetection device 1 is connected to a server via a network, and aportable storage medium such as an optical disk.

When outputting the supplementary information, output processing section31 c reads out the inspection image data associated with third mark 53 e(or fourth mark 53 f) from storage section 34 and outputs the inspectionimage data to another device.

An exemplary operation of gas detection device 1 will be described withreference to FIG. 12 . FIG. 12 is a flowchart illustrating an exemplaryoperation of the gas detection device 1.

Firstly, in step S400 illustrated in FIG. 12 , image processing section31 a receives infrared image data from infrared imaging section 22 andreceives visible light image data from visible light imaging section 21.

Next, in step S410, image processing section 31 a generates aninspection image data based on the infrared image data and the visiblelight image data.

Next, in step S420, control section 35 stores the inspection image datain storage section 34.

Next, in step S430, control section 35 determines whether an instructionto reproduce inspection image data 7 is input via operation section 33.When the reproduction instruction is input (“YES” in step S430),processing shifts to step S440. When the reproduction instruction is notinput (“NO” in step S430), processing returns to the condition beforestep S430.

Next, in step S440, processing section 31 generates a reproductionscreen. Specifically, time information generating section 31 d generatesthe image data of first bar element 53 a, second bar element 53 b, thirdbar element 53 p, and fourth bar element 53 q.

Next, in step S450, display processing section 31 b displays thereproduction screen on display section 32. Thus, seek bar image 53 isdisplayed in the first region of the reproduction screen. Seek bar image53 is displayed in the second region of the reproduction screen.Supplementary information input image 5 is displayed in the third regionof the reproduction screen.

Gas detection device 1 according to the embodiments described aboveincludes: image processing section 31 a that visualizes a gas in theinspection region by performing the image processing on the infraredimage data in the inspection region imaged by infrared imaging section22; a gas detection section (image processing section 31 a) that detectsthe gas based on a result of the image processing; and displayprocessing section 31 b that displays inspection image 7 reflecting theresult of the image processing and displays second bar element 53 b(detection time information) indicating a time when the gas is detectedby image processing section 31 a. Such gas detection device 1 enablesvisually recognizing inspection image 7 efficiently based on second barelement 53 b. As a result, the user can select with ease inspectionimage 7 corresponding to second bar element 53 b from among inspectionimages 7 and submit, to a requester (a client), selected inspectionimage 7 attaching a report.

In the above embodiments, display processing section 31 b emphaticallydisplays an evidence mark according to a position of reproducingposition mark 53 g (a slider). For example, when the position of theslider is located in a predetermined time of an evidence mark, displayprocessing section 31 b emphatically displays the next evidence mark inthe same predetermined time. This enables visually recognizinginspection image 7 efficiently based on the importance of theemphatically displayed evidence mark.

In the above embodiments, when any one of first mark 53 c to fourth mark53 f is designated via operation input section 33, display processingsection 31 b may display reproducing position mark 53 g (the slider)returning to the position corresponding the initial frame of an offsetvalue (e.g., an amount of data in a predetermined few seconds) from thedesignated mark.

In the above embodiments, when a position other than the slider in seekbar 53 is tapped via operation input section 33, display processingsection 31 b may display the slider, moving the slider to the tappedposition. Thus, the reproduction of inspection image 7 is continued fromthe tapped position. In addition, when the slider is held via operationinput section 33, display processing section 31 b may display theslider, holding the slider in the hold position. Thus, the reproductionof inspection image 7 is stopped when inspection image 7 is beingreproduced. Furthermore, when the slider is released via operation inputsection 33, display processing section 31 b may display the slider in areleased state. Thus, the reproduction of inspection image 7 is resumed.

In the above embodiments, an evidence (supplementary information) havinghigh importance may be set in a higher layer. By contrast, an evidencehaving low importance or an unnecessary evidence may be set in a lowerlayer. When the importance is the same among evidences, the morerecently updated evidence may be set in a higher layer. When an evidencemark is emphatically displayed, the evidence may be moved to the higherlayer so as to be easily selected. Since the position of the layerchanges depending on the importance of the evidence, the evidence can behandled easily.

In the above embodiments, time information generating section 31 dgenerates selection range information 53 h such that fourth bar element53 q that means an invalid part of the inspection image data is notincluded in selection range information 53 h.

In the above embodiments, display processing section 31 b may displaysecond bar element 53 b indicating a time when a gas is detected, whilechanging the depth of a color according to an amount of leaked gas. Thisenables the user to recognize the degree of risk. Display processingsection 31 b may display second bar element 53 b more emphatically whenthe amount of leaked gas exceeds a predetermined amount. In this case,display processing section 31 b, for example, may display a screen ofinspection image 7 so as to surround the screen of inspection image 7 bya red frame.

In the above embodiments, display processing section 31 b may displayseek bar image 53, while reflecting thereon a mark indicating aseparation position for every predetermined time of data.

In the above embodiments, display processing section 31 b displays seekbar image 53 during reproduction of inspection image 7; however, seekbar image 53 is not limited to this and may be displayed during imaging.

In the above embodiments, display processing section 31 b displays seekbar image 53 corresponding to inspection image 7; however, seek barimage 53 may be displayed corresponding to infrared image data afterimage processing, infrared image data before image processing, visibleimage, or temperature image.

Although the disclosure has been described with respect to only alimited number of embodiments, those skill in the art, having benefit ofthis disclosure, will appreciate that various other embodiments may bedevised without departing from the scope of the present invention.Accordingly, the scope of the invention should be limited only by theattached claims.

REFERENCE SIGNS LIST

-   1 Gas detection device-   2 Imaging device-   3 Gas detection device body-   4 Cable-   5 Supplementary information input image-   6 a Plant-   7 Inspection image-   7 a Gas image-   21 Visible light imaging section-   22 Infrared imaging section-   31 Processing section-   31 a Image processing section-   31 b Display processing section-   31 c Output processing section-   31 d Time information generating section-   32 Display section-   33 Operation input section-   34 Storage section-   35 Control section-   53 Seek bar image-   53 a First bar element-   53 b Second bar element-   53 c First mark-   53 d Second mark-   53 e Third mark-   53 f Fourth mark-   53 g Reproducing position mark-   53 h Selection range information

The invention claimed is:
 1. A gas detection device, comprising: aninput interface that receives an input of supplementary information onan inspection image; a processor that: visualizes a gas by performingimage processing on infrared image data in an inspection region imagedby an imaging device; detects the gas based on a result of the imageprocessing; and displays: the inspection image reflecting the result ofthe image processing; detection time information indicating a detectiontime of the gas; reception time information indicating a time when theinput of the supplementary information is received by the inputinterface; and a seek bar that has a time axis and shows the detectiontime information along the time axis, wherein the seek bar further showsa first time slot during which reliability of gas detection isdetermined by the processor to be low.
 2. The gas detection deviceaccording to claim 1, wherein the processor displays the inspectionimage and the detection time information in accordance with aninstruction of a user.
 3. The gas detection device according to claim 1,wherein the seek bar further shows the reception time information. 4.The gas detection device according to claim 1, wherein the processoroutputs the supplementary information to an output device.
 5. The gasdetection device according to claim 4, wherein the processor outputsinspection image data in selection range information indicating aselected time slot in accordance with the reception time information. 6.The gas detection device according to claim 5, wherein the processoroutputs the inspection image data in the selection range informationtogether with the supplementary information on the reception timeinformation.
 7. The gas detection device according to claim 1, whereinthe processor determines the reliability of the gas detection based onsignals from at least one of a temperature sensor, a wind speed sensor,and a vibration sensor.
 8. The gas detection device according to claim1, wherein the seek bar further shows a second time slot during which agas is detected, while changing a depth of a color of the second timeslot according to an amount of leaked gas.
 9. The gas detection deviceaccording to claim 1, wherein the seek bar further shows, in addition tothe first time slot, a second time slot during which a gas is detectedand a third time slot during which no gas is detected such that thefirst, second, and third time slots can be identified.
 10. A gasdetection method, comprising: receiving an input of supplementaryinformation on an inspection image; visualizing a gas by performingimage processing on infrared image data in an inspection region imagedby an imaging device; detecting the gas based on a result of the imageprocessing; and displaying: the inspection image reflecting the resultof the image processing; detection time information indicating adetection time of the gas; reception time information indicating a timewhen the input of the supplementary information is received; and a seekbar that has a time axis and shows the detection time information alongthe time axis, wherein the seek bar further shows a first time slotduring which reliability of gas detection is determined to be low.
 11. Anon-transitory computer-readable recording medium storing an instructionfor a gas detection device, the instruction causing the gas detectiondevice to execute: receiving an input of supplementary information on aninspection image; visualizing a gas by performing image processing oninfrared image data in an inspection region imaged by an imaging device;detecting the gas based on a result of the image processing; anddisplaying: the inspection image reflecting the result of the imageprocessing; detection time information indicating a detection time ofthe gas; reception time information indicating a time when the input ofthe supplementary information is received; and a seek bar that has atime axis and shows the detection time information along the time axis,wherein the seek bar further shows a first time slot during whichreliability of gas detection is determined to be low.